← All datasets

Metagenomics

EMG produced TPA metagenomics assembly of the PRJNA46333 data set (Gene-Environment Interactions at the Skin Surface).

Microbial functional profiles from the Gene-Environment Interactions at the Skin Surface project. The benchmark uses MGnify InterPro abundances from assembled sequences to predict the recorded environmental material associated with each sample.

Binary classificationLicence: PublicMGYS00005379Target: environment (material)mgnify ↗

Mean cross-validation scores for this dataset. Each score comes from the requested feature- and sample-cap cell, and failed fits use the constant predictor.

At this operating point

Model comparison

p=10,000, n=100 · Higher Macro-F1 is better

Random Forest is marked with a diamond. Models are ordered by the selected metric.

Across sample budgets

Learning curves

All metric values at this operating point
ModelMacro-F1MCCBalanced accuracyROC-AUC
RealTabPFN 2.50.68210.63470.62710.9064
TabPFN Wide (8k) ‡0.65820.56060.61590.9047
Logistic Regression0.64490.58510.58590.9325
TabFM0.62120.63480.58560.9225
TabDPT †0.60140.54290.55250.9132
AutoGluon0.59890.53770.55790.9177
MLP0.59560.45920.57540.9044
RealTabPFN v20.59110.56040.54080.9287
TabPFN 30.55950.510.51540.9195
TabPFN Wide 5k (ne3) ‡0.55060.44860.50050.904
RealMLP0.52820.42530.52890.8998
Random Forest0.44860.26920.42330.8804
LightGBM0.41460.18920.40040.8592
CatBoost0.40460.20230.3980.8255
XGBoost0.4040.18310.39550.8177
Extra Trees0.40160.20740.38690.896
MITRA0.39530.17330.38940.8078
KNN0.36590.10660.3650.735
TabM0.32830.034050.3410.7638
TabICL v20.313600.33330.5